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Abstract 



(N 

K*" ' It is demonstrated that power-laws which are modified by logarithmic corrections arise in 

^r^ ■ supercorrelated systems. Their characteristic feature is the energy attributed to a state 

^^ ' bution of the constituents. A onedimensional dissipative deterministic model is introduced 

Q I which is attracted to a supercorrelated state (phase space entrainment). Extensions of 

this particular model may have applications in the study of transport and equilibration 



phenomena, particularly for supply and information networks, or for chemical and biolog- 
ical nonequilibrium systems, while the qualitative arguments presented here are believed 



P3 ' to be of more general interest. 
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^ . 1 Introduction 

Power-laws are omnipresent in natural or man-made systems ^ |2] . They arise in the areas 
of high-energy particle physics, condensed matter, complexity, sociology, and linguistics, to 
name a few. They are an important feature of Tsallis statistics [Sill]- While numerous out-of- 
equilibrium statistical systems are known showing this behavior, only rarely the dynamics is 
understood that leads to it. 
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In this letter we study systems that are correlation dominated, in a sense to be more 
accurately defined. We show that in this class of models the asymptotic spectra are essentially 
given by power-laws, however, modified by logarithmic corrections. They appear quite similar 
from a phenomenological point of view. 

Recently, for example, most interesting transient dynamical behavior has been observed 
in relativistic heavy- ion collisions [Sj. It is observed that apparently thermodynamics rules, 
with a local equation of state, in particular, and commencing at unexpectedly early times (of 
order 0.3 — 0.9xl0~^^s) during the collision process. However, the experiments also indicate 
that typical one-particle observables are not correspondingly thermalized by that time. The- 
oretical investigations based on quantum field theoretical models support the view that such 
'prethermalization' is indeed produced jH]. This is accompanied by spectra, which show consid- 
erable deviations from Fermi-Dirac, Bose-Einstein, or Boltzmann distributions, with uniform 
parameters, and which relax to the equilibrium form only on a much longer time scale. 

However, a heuristic picture which allows us to understand essential features of the under- 
lying processes generally has been lacking. Recently, we have shown that such behavior can 
be interpreted in terms of certain correlations generated dynamically and, in fact, power-laws 
can emerge as a consequence j3| . Presently, we start with a different class of models. In some 
limits analytical results can be obtained, the models can be easily generalized, and may be 
applied in quite different contexts. We demonstrate the emergence of log-modified power-laws 
as a robust feature in supercorrelated systems where correlations among the distributions of the 
constituents govern the statistical behavior. 

Other recent works invariably invoke stochastic processes in the explanation of power-laws, 
e.g., in Refs. [3 |H1 IHl 1101 El ■ In distinction, we present a deterministic dissipative model where 
microscopic stochastic processes are subsumed in suitable (anti) damping terms of otherwise 
Hamiltonian equations of motion. We demonstrate that phase space entrainment leads to 
supercorrelation here and, thus, ultimately to the log-modified power-laws. 

2 Supercorrelated systems 

Specifically, we consider a two-dimensional 'phase space' spanned by a discrete 'spatial' coordi- 
nate X G {xi, i = 1, . . . , L} (with periodic boundary condition) together with a discrete 'energy' 
coordinate E G {Ej, j = 1, . . . M}. We would like to understand the statistical behavior of a 
system consisting of L 'particles', which are distributed randomly over the energy E, however, 
with exactly one particle per lattice site x. 

The interpretation assigned to the coordinates may vary according to circumstances. In 
particular, the 'energy' may generally represent any cost function. 

Crucially, we assume that there is a characteristic energy Ej associated with the j-th state 



of the system. Furthermore, it is the product of this energy times a correlation function Cj 
which yields the relevant effective energy. Only the latter will determine the relative weight 
of terms in a sum over states. More precisely, the correlation function Cj [p] is determined by 
a product of particle distributions p. The number of factors of p involved will be called the 
correlation degree c. (Out of a sum of terms of different degree only the one with smallest c 
matters asymptotically.) 

Before we proceed, we define this correlation energy in various examples: 

• If the correlation is between a particle at site x and a second one a distance Ax away, 
then the contribution to the total energy is: 

E EjC,[p] = J2 E,p{^r, E,)p{x, + Aa;, E^) . (1) 

Note that all possible pairs (c = 2) are counted here exactly once, due to the periodic 
boundary condition. 

• Another case of interest is that the correlation of the particles does not depend on the 
mutual distance, corresponding to the limit that the interaction length is larger than the 
system size. Ax > x^ — Xi. 

H EjCj [p] = E Ejp{xi^ , Ej)p{xi2 ,Ej)- ...■ p{xi^, Ej) , (2) 

j h<i2<---<ic\j 

with c ordered factors of p, not restricted otherwise because of lattice periodicity. 

• Finally, we may have an anticorrelation instead of the previous case: 



Y.EfiM^llE,p{x^,,E,)[l- J2 pix,„E,)-...-pix,^,E,)) . (3) 

j ii;j ii<i2<...<ic 

Numerous further variants can be imagined. 

It seems worth while to discuss various features here. First of all, it is important to real- 
ize that the energies Ej need neither be related to single-particle nor to bound-state energy 
levels. The energy Ej, or a fraction thereof, is contributing here to the extent that the parti- 
cle distribution maximizes the correlation function, or minimizes it, depending on the details 
of Cj[p]. Thus, we are studying the nonlinear problem of statistical distributions of particles 
(one per lattice site) over states j when the effective energy depends itself on the distribution, 
Ej — > EjCj[p]; generally, it may as well depend on j explicitly. Hence, we call such systems 
supercorrelated. 

The relation between supercorrelated statistics and dissipative yet deterministic dynamics 
shall be discussed in the following section of this letter. 



Furthermore, a little thought shows that the examples of Eqs. (^Q) and (j21) will tend to 
enhance the probability of rare configurations of the system, relative to the case of Boltzmann- 
Gibbs equilibrium statistics. Similarly, the example (jH)) will enhance the frequent ones. These 
expectations will be confirmed by the following calculations. 

We look for the least biased probability distribution p{x, E) describing an ensemble of such 
systems, subject to the additional constraints representing the average total energy {E) and 
the fixed particle number L. Optimizing the Shannon (information) entropy functional, we are 
lead to a variational determination of the probability distribution: 

5($:p(x„E,)ln[p(x„E,)]+/?(^C,b]E,-(i^)) 

+ ^{X{x.)-l){Y^p{x,,E,)-l)) = . (4) 

i J 

Here (3 and A are Lagrange multipliers incorporating the average energy and fixed particle 
number constraints. 

A remark is in order here. The mathematical foundations of statistical mechanics of super- 
correlated systems, as introduced in this work, certainly need further study. Presently, we do 
not presume a detailed relation to thermodynamics, even though some of the following results 
are suggestive in this direction (see also the discussion in Ref. jTj). However, the application 
of the variational principle for the Shannon entropy is justified, since the searched-for (nor- 
malized) distribution p{x, E) refers to a closed system which is thought to be realizable in a 
sufficiently large number of cases, thus defining the ensemble ^21 ^] ■ What is nonstandard 
here, is the nonlinear (in p) constraint incorporating the correlation energy or cost function.^ - 
Since the present nonlinearities bear some resemblance to the ones of escort distributions, we 
anticipate that further developments will allow to relate the present approach to superstatistics 
|14j . where such distributions can be successfully dealt with in a canonical framework |15j . 

We proceed to perform the variations and, thus, obtain the following set of equations: 

J2p{x„E,) = 1 , (5) 

j 

J:CAp]E, = {E) , (6) 

j 

ln\p{xk, E,)] + ^-^ J2 Pi^h^Ej) ■ . . . ■ p{xi^,E,) + \{xk) = , (7) 

where we chose the example of Eq. ((21) in the last equation; the prime on the sum indicates that 

the sum is only over those terms which contain the factor p{xk, Ej). 

^Restriction to any particular form of the constraints is not required by the arguments leading to the 
variational principle for the Shannon entropy |12[ I13| . 



Combining Eqs. (0) and ((Tj), the Lagrange multiplier A can be eliminated to obtain implicitly 
the normalized distribution: 

r PE- ' 

p(xfc,Ej) =Z"^(xfe)exp[ ^— Y. Pixh,Ej)- ■■■■p{x,^,Ej) 

with the partition function, 

Z(xfc)=^exp[- ^ Y. Pixii,Ej)- ...■p{xi^,Ej)] . (9) 

j P{Xk,J^j) ji<...<v 

In principle, the Eq. (jHI) serves to fix (3. However, instead, we may choose to work with the 
distribution as it is, considering /? as a macroscopic parameter characterizing the ensemble.^ 

In the absence of localized impurities or dissipative effects, the system cannot spontaneously 
break (lattice) translation invariance. With this simplification, the distribution has to be 
homogeneous in space, 

p{xk,Ej)=p^,{E^) , (10) 

i.e., the same at any chosen lattice site. This allows us to simplify Eq. (jH}: 

p,.(E,) = Z-' exp [ - PN,E,plr\E^)] , (11) 

where Z^ is the correspondingly simplified partition function, cf. Eq. Q. The combinatorial 
factor is given by: 

iVc = c I M . (12) 

Note that for c = 1 we recover Boltzmann statistics, however, with a renormalized temperature, 
which is due to the presence of L identical copies of the system, in this case. 

The transcendental Eq. (Illj) is of the form P = exp(— r^P), with P = [p^Z^Y'^ and r] = (c — 
l)(3NcEjZ]r'^. Its solution can be given in terms of the Lambert PF-function, P{ri) = W{r])/r]. 
In the limit r/ -C 1, one obtains the following approximation: 

p.{E,) = Z-'- ^ -^j^^ , ^ « 1 , (13) 

(l + (c-l)Zi-/5iV,E,y^ 

which yields a power-law with exponent dictated by the correlation degree. This is a typical 
form of the Tsallis distribution |Slll], or of Zipf's law as generalized by Mandelbrot dl^I- In 
the opposite limit, a log-modified power-law results: 

l/(c-l) 



_, fF((c-l)Zl-^(3NcEi 



^This is analogous to working with a standard canonical ensemble, where /? would correspond to the inverse 
temperature, /3 = l/T, in units where A:g = 1. 
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with the function F defined by: 

F(x) =ln(a;)(l + ln(ln(x))/ln(x))~^ . (15) 

In the example of Eq. (^, we would find similar results in the homogeneous limit, differing only 
by the appropriate correlation degree and the combinatorial factor. 

We remark that there is a considerable similarity between the Zipf-Mandelbrot law pH|) 
and the distribution (fT^ . when the former is also applied in the limit r] ^ 1. In a log-log 
representation one could perhaps be mistaken for the other (for a limited range of data) by 
readjusting the parameters. 

In any case, having obtained the probability distribution Px{E) for positive integer values of 
c, it is tempting to extend the definition of the correlation degree to all real positive numbers. 
In Eq. fll2|) this is implemented by employing the Gamma function instead of factorials, and 
it can obviously be done in Eq. pij) . for c > 1; a comment concerning c < 1 will follow 
shortly. However, can we understand such analytic continuation also in terms of the picture of 
supercorrelated systems? 

Physically, we expect that supercorrelations which are not fully developed somehow should 
correspond to noninteger correlation degree here. Indeed, let us focus on situations with c 
sufficiently close to an integer. Here, an expansion provides a hint for the interpretation. For 
example, we may consider the phenomenologically interesting case c = 1 + 7, with 7 sufficiently 
small |lj. We obtain: 

p'+^=P-(l-7g-^7(l-7)g' + 0(g3)) . (16) 

We recognize a particular form of anticorrelation. For example, this can correspond to a term 
oc p{xi)\i — '~fq{xi + Ax)], which presents a correlation with a 'hole' distribution, q = 1 — p, 
modifying the leading Boltzmann term. This should be compared to the different correlation 
and anticorrelation defined in Eqs. (Hj) and Q, respectively. 

To complement these remarks, we briefiy recall the anticorrelation of Eq. Q, instead of 
Eq. (jSJ. The result replacing Eq. (fTT|l is simply: 

PxiE,) = Z-' exp [ - /3E, (1 - N,p:-\E,)) ] . (17) 

Here, for c > 1, the second term in the exponent presents a small correction to the leading 
Boltzmann term, which vanishes exponentially for /3Ej ^ 1. 

An interesting situation arises for c < 1. - Both, the Eqs. ()11|) and (|T7jl cease to have 
solutions for px{Ej) for sufficiently large (3Ej in this case. This is refiected in the pole which 
arises in the power-law result of Eq. ()13p. when continued to c < 1. Similarly, for example, the 
power-law obtained here from Eq. ()17|). 

P^^^^^-^^ 1 1 + (1 - c)PE, ) ' ^^^^ 



breaks down, when unavoidably Px{Ej) -^ 1, for sufficiently large energy. Therefore, a cut-off 
on Ej is necessary here, as discussed in the applications of TsaUis statistics before jlj. 

3 Via phase space entrainment to supercorrelation 

It is not the purpose of this section to develop the statistical mechanics of supercorrelated 
systems from the bottom up. Since the present approach is entirely new, our modest aim here 
is to show in a simple example, based on analyzing the asymptotic solutions of the equations 
of motion, how phase space entrainment occurs and leads to supercorrelations as defined in 
the previous section. - An extension of the simplest two-body system to a more realistic one- 
dimensional lattice model and its mean field analysis are contained in a ffist version of this 
letter [TT)] . 

Therefore, fundamental questions, such as related to the (non)thermalization of the Hamil- 
tonian system presented in the following, to the H-theorem, or to the fluctuation-dissipation 
theorem, when the system is made dissipative in a particular way by incorporating phaenomeno- 
logical (anti)damping terms in the equations of motion, must be deferred to future microscopic 
statistical mechanics studies of such systems. 

Here, to begin with, correlation energies, such as defined in Eqs. (^-(jBI), must reflect an un- 
derlying microscopic dynamics in a coarse-grained way. In order to further illustrate the notion 
of correlation energy, we consider here a two-body Hamiltonian, T-i(Ili, Ei]Il2, E2) , describing 
the interaction of two 'cells' (called 'particles' before) localized at two given sites "1" and "2" 
of, for example, the previous onedimensional lattice. In distinction to ordinary Hamiltonian 
dynamics, we treat the local energies, -Ei,2, in place of a coordinate, together with the canonical 
momenta. Hi 2. Phase space consists of the 2x2- dimensional (H, £^)-space (-E'1,2 > 0). 

The precise form of our Hamiltonian is solely dictated by mathematical convenience in 
modelling the following phaenomenological features: 

• two subunits (cells, agents, etc.) of the system, i.e. sites "1" and "2", exchange energy 
(adjust a potential difference across a biological membrane, trade a commodity, etc.) in 
an oscillatory way; 

• the total amount of energy (base potential, commodity, etc.) distributed in the system is 
conserved; 

• the ensuing Hamiltonian dynamics may be nonlinear; 

• the exchange process is damped, while preserving the overall conservation of energy (etc.). 
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We will continue to use the term 'energy' henceforth. However, the versatility of such a model 
should be kept in mind. We believe that this type of systems is generic in that it produces 
some kind of supercorrelation. 

Employing more convenient continuum notation, the average energy (S) corresponding to 
H for a pair of cells is: 

(S) = {27r)-^ J dU,dE,dU2dE2n{UuEi;U2,E2)p{IluE,;U2,E2) , (19) 

in terms of the phase space pair probability density p, and where our model Hamiltonian is: 

n{U,, E,- U2, E2) = ^^J^ exp[-r'(ni - Hs)' - Q-^E^ - E^f] = £ , (20) 

with ^, C constant parameters. 

Using variables Tl± = Hi ± 112 and E± = Ei ± E2, and with the conserved total energy S 
of Eq. ()20|) . the equations of motion for this Hamiltonian can be combined to yield: 

(21) 
(22) 

(23) 
(24) 



Thus, we find a harmonic oscillator with a constant frequency. However, the frequency strongly 
depends on the initial conditions, being exponentially smaller when the two cells start out far 
away from each other in phase space (H_ or E^ large), than when they are close. There is a 
rapid energy swapping in the latter case, while it is slow in the former. 

We expect internal dissipative forces in coarse-grained descriptions of interacting microscopic 
systems. Presently, this dissipation is assumed to conserve the total energy S. Therefore, it 
has to change the energy sum E^, at the expense of damping the swapping of energy between 
the cells, which is described by the oscillation of the energy difference E_ (and of H_). This 
can indeed be implemented by modifying only two of the Eqs. (PT|) - P^ . 

E+ = -2^{E_/CYe+ , (26) 



E+ = 


, 




n+ = 


-2SE-^ 


1 


E_ = 


-fn-, 




ri_ = 


f-, 




or, in particular, the second order equation: 






E_ + uj^E_ = 


, u' = 


(''S- 



AS, 



E- = -— H_-7E_ , (27) 
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keeping the other two. This results in the damped oscillator equation: E_ + 'yE^ + uj'^E_ = 0, 
where 7 is the damping constant, and with uj"^ the same as before. 

The following properties can be read off immediately from the equations of motion (f^^ . 
(EH), f|^- and (jTfj) : (A) The amplitude of the oscillating energy difference E_ (and its deriva- 
tive) is damped to zero (oc exp[— 7t/2]). - (B) The energy sum E+ for the two cells decreases 
monotonically from its initial value and saturates exponentially (with rate 7) at its finite asymp- 
totic value. - (C) The oscillating 'momentum' difference n_ decreases exponentially to zero 
(oc exp[— 7t/2]). - (D) The corresponding sum 11+ decreases monotonically (oc —t) for late 
times. Note that U^ does not enter the Hamiltonian. 

From these observations we obtain the asymptotic time dependence of each cell's 'coordinate' 
and 'momentum': 

Ei,2(t) = -{E+±E_) ^ a+(l + ae-^*) ± a_e-^* , (28) 

ni,2(t) = ^(n+±n_) ^ b+{b-t-b'e-"")±b_e'"" , (29) 

with constants depending on the initial conditions, besides ^,C, and 7 and u ("1" with upper 
signs, "2" with lower ones). We suppress oscillating factors here, thus emphasizing the presently 
important terms; using the full solutions, it can easily be verified that they do not affect the 
following argument. 

The dynamics described by Eqs. fl^ . (j^ . (j^ . and (P7j) is dissipative. Obviously, there is 
a onedimensional attractor, see Eqs. ()28|) - (f^^ . However, it is the pairing of variables which is 
most characteristic: the two cells considered are forced to follow similar trajectories in phase 
space, which converge asymptotically to one and the same (even with oscillation factors in- 
cluded). Simultaneously, the Hamiltonian is a constant of motion, 7i = S, i.e., the overall 
energy (or other quantity represented by the cost function) is conserved. 

This phase space entrainment is an essential ingredient for supercorrelated statistics in this 
illustrating example. Let us consider an ensemble of such pairs of cells with distributed initial 
conditions. Then, the Liouville equation, including the appropriate dissipative terms (oc 7), 
describes the evolution of the ensemble in phase space. Any solution of this equation for the 
probability density can be written in the form: 

p{U,E-t)=p[U-U{t),E-E{t)) , (30) 

where the vectors collect the components "1,2", and where I{{t)^E{t) present a solution of the 
equations of motion, e.g., asymptotically as in Eqs. (J28|l - (j29|) . 

Considering initial distributions which are factorized, akin to Boltzmann's 'Stosszahlansatz' 
(molecular chaos), p{U, E;t) =p (Hi - Hi(0), Ei - Ei(0)) -p (H2 - H2(0), E2 - ^2(0)), one ob- 
tains correspondingly factorized solutions at all times. 
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Employing this fact, we further evaluate Eq. (|19p together with (|2(Jj). Since the Hamiltonian 
is a constant of motion, the average energy can be evaluated at any (late) time. Neglecting 
exponentially small corrections, see Eqs. (j^H|) - (j^ . we obtain: 

■ p(n - h+{h -t),E- a+) ■ p(ll -h+{h-t) + An, E - a+ + Ag) (31) 

^5^ i? p(n, E) p(n, E) , (32) 



where we substituted 112 = n+ An and E2 = E+Ae, and with 11, E instead of Hi, Ei earlier; the 
further approximation here consists in replacing the Gaussians by 5-functions (for sufficiently 
small ^,C); where, more generally, gradient corrections come into play. The constant shift of 
the energy by — a+ has been absorbed into a redefinition of the distribution p, i.e., of the initial 
condition. Thus, we obtain a phase space generalization of the simplest case of supercorrelation 
(c = 2) and corresponding correlation energy, cf. Eq. (Q), in our two-cell example. 

We remark that the intermediate result of Eq. ()3H) indicates a natural generalization of 
the correlation energies of Eqs. (^-(jSJ, namely allowing a certain spread of the energy when 
summing over states. 

Having demonstrated the emergence of supercorrelations in an almost trivial example, which 
in turn form the starting point of the derivations of the previous section, we conclude here with 
two remarks concerning more realistic generalizations of this model. 

A many-body system made up from subunits which interact pairwise, as investigated here, 
is bound to have rich transient dynamics, due to locally varying and time dependent effective 
oscillator frequencies pBl- In the two-cell example, the one frequency depends strongly on 
the initial condition. However, energy conservation prevents its variation. In general, local 
energy conservation will amount to only a global constraint and the frequencies vary locally, 
depending on the system variables. This may initially lead to the formation of 'hot spots', with 
rapid energy swapping between neighbouring cells, and relatively inactive regions elsewhere. 

Furthermore, without adding further couplings to the basic Hamiltonian, the model cannot 
thermalize, i.e., sustain a certain amount of fluctuations. This can easily be changed in a future 
extension by modifying the decription of damping of the relative motion between interacting 
cells and feedback of the dissipated energy into the system. For example, a damping term like 
for the van der Pol oscillator could be considered. This would raise the dimensionality of the 
underlying attractor and generate more interesting behavior, especially in a many-body system. 
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4 Conclusions 

This letter has addressed the dynamical origin of power-laws. We have introduced the notion 
of supercorrelated systems where, as a result of interactions among its constituents, the energy 
or a more general cost function depend effectively on the distribution of the constituents. 

This leads to a nonlinearity in the evaluation of sums over states, such as calculating the 
partition function, and in the determination of the "would-be-equilibrium" distributions. We 
showed that asymptotically the resulting distributions are (log-modified) power-laws, with 
parameters determined by the correlation degree characterising the correlation energy, see 
Eqs. (IH)-®, besides macroscopic parameters of the system. 

These results follow from a simple statistical analysis and indicate that a wide range of 
models can be conceived which lead to such distributions. The crucial point consists in the 
identification of the relevant correlation energy, depending on the underlying dynamical model. 

We presented a very simple deterministic dissipative model of interacting cells, where the 
interaction causes redistribution of the energy content among cells. While the overall energy of 
the system is conserved, the rate of change of gradients of the energy content of cells is damped 
by a dissipative force. 

The model has interesting nonlinear features which deserve further study. Presently, we have 
considered only two interacting subunits of the system, while also a mean field approximation of 
a onedimensional lattice model has been studied with analogous results [16^ . In its present form, 
the model cannot lead to thermodynamic equilibrium. However, an extension achieving this 
can easily be defined. For our purposes most important has been the fact that the dissipation 
leads to phase space entrainment, i.e. the oscillator degrees of freedom are forced to converge 
on a simple attractor in phase space. 

While the effectively linear dynamics of the present model is rather trivial, it demonstrates 
how supercorrelations arise, which in turn generate (log-modified) power-laws. 

It will be very interesting to learn about the time dependent behavior of the system when 
nonlinearities and further thermalizing couplings are introduced. Then, interesting questions 
may be raised concerning the (non)equilibrium character of the obtained distributions and the 
thermodynamic interpretation of the information entropy, on which our derivations are based. 
Thus, one may find a testing ground for ideas about the prethermalization mentioned in the 
Introduction. Our model presents a coarse-grained picture of microscopic dynamics, which may 
be difficult to access directly in complex systems. Thus, refined versions may have interesting 
applications in studies of transport and equilibration properties of condensed matter, polymer, 
or generally network structures. 
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